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BACKGROUND OF THE INVENTION 

1) Field of the Invention 

The present invention relates to a technique for controlling an 
unfolding operation of an air bag based on a distance between a person 
15 seated in a vehicle and a predetermined point. 

2) Description of the Related Art 

It is a common practice to detect a distance between an object 
and a predetermined point, and use the detected distance as a 
20 parameter to control something. For instance, it is known to control 
spreading out of an air bag in case of a car accident based on the 
distance between a passenger and a predetermined point. 

In an air bag system, when a vehicle collision is detected, a 
balloon is blown by a constant explosive power. Japanese Patent 
25 Application Laid-open No. 2001-213268 discloses a technology to 



detect a distance between a predetermined position (a position of 
forward side of an occupant) and an occupant in a seat in a vehicle, 
and then control unfolding of an air bag based on the distance so as to 
protect the occupant from being injured by the air bag. For instance, if 
5 the distance is short, the air bag is made to unfold with weaker force for 
the safety of the occupant. 

In Japanese Patent Application Laid-open No. 2001-213268, a 
spot beam light is irradiated to the occupant to acquire an image of the 
occupant. Based on the image, a distance between the occupant and 

10 the predetermined position is detected to judge the occupant position. 
Thus, it is possible to detect a distance between a part of the body of 
the occupant, which is irradiated by the spot beam light, and the 
predetermined position. However, although it is possible to detect a 
distance between a predetermined part of the body of the occupant and 

15 a predetermined position, it is impossible to detect a distance between 
the other parts of the body of the occupant and the predetermined 
position. 

In other words, if the object can take various postures when 
seated on a vehicle, it may be possible to detect a distance between 
20 only a partial position of the occupant and the predetermined position; 
however, it is impossible to detect a distance between the other part of 
the object and the predetermined position. This may cause 
inappropriate control of the air bag system because of discordance 
between an actual position of the object and the detected distance. 
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SUMMARY OF THE INVENTION 

It is an object of the present invention to solve at least the 
problems in the conventional technology. 

A distance detecting apparatus according to an aspect of the 
5 present invention includes a light emitting unit that emits a light in a 
light emitting direction which is the direction to an object, the light 
having a distributed pattern in a predetermined direction; a 
photographing device that obtains an image of the object along with a 
photographing direction; a holding mechanism that holds the light 

10 emitting unit and the photographing apparatus in such a relation that (a) 
the photographing direction is not in a plane that includes both the light 
emitting direction and the predetermined direction of the distributed 
pattern, and (b) the photographing direction is not parallel to the light 
emitting direction; and a distance deriving unit that derives a distance 

15 between the object and a predetermined position based on the image 
obtained by the photographing device. 

An air bag system controlling apparatus according to another 
aspect of the present invention includes a light emitting unit that emits a 
light in a light emitting direction which is the direction to an object 

20 seating on a seat of a vehicle, the light having a distributed pattern in a 
predetermined direction; a photographing device that obtains an image 
of the object along with a photographing direction; a holding mechanism 
that holds the light emitting unit and the photographing apparatus in 
such a relation that (a) the photographing direction is not in a plane that 

25 includes both the light emitting direction and the predetermined 



direction of the distributed pattern, and (b) the photographing direction 
is not parallel to the light emitting direction; a distance deriving unit that 
derives a distance between the object and a predetermined position 
based on the image obtained by the photographing device; and an air 
5 bag system controlling unit that controls an operation of an air bag 
based on the distance derived. 

An air bag system controlling apparatus according to still 
another aspect of the present invention includes a light emitting unit 
that emits a light in a light emitting direction which is the direction to an 

10 object the light having a distributed pattern in a predetermined 

direction; a photographing device that obtains an image of the object 
along with a photographing direction; a holding mechanism that holds 
the light emitting unit and the photographing apparatus, in such a 
relation that (a) the photographing direction is not in a plane that 

15 includes both the light emitting direction and the predetermined 

direction of the distributed pattern, and (b) the photographing direction 
is not parallel to the light emitting direction; a memory unit that stores a 
computer program that makes it possible to execute a function of 
deriving a distance between the object and a predetermined position 

20 based on the image obtained by the photographing device, and a 

function of controlling an operation of an air bag based on the distance 
derived; and a processor that can access the memory unit and execute 
the computer program. 

A distance detecting apparatus according to still another aspect 

25 of the present invention includes a light emitting unit that emits a light in 



a light emitting direction which is the direction to an object, the light 
having a plurality of pattern lights that are parallel to each other; a 
photographing device that obtains an image of the object along with a 
photographing direction; and a distance deriving unit that derives a 
5 distance between the object and a predetermined position based on an 
interval between the pattern lights in the image. 

An airbag system controlling apparatus according to still another 
aspect of the present invention includes a light emitting unit that emits a 
light in a light emitting direction which is the direction to an object 

10 seated in a seat of a vehicle, the light having a plurality of pattern lights 
that are parallel to each other; a photographing device that obtains an 
image of the object along with a photographing direction; a distance 
deriving unit that derives a distance between the object and a 
predetermined position based on an interval between at least two of the 

15 pattern lights in the image; and an air bag system controlling unit that 
controls an operation of an air bag based on the distance derived. 

An airbag system controlling apparatus according to still another 
aspect of the present invention includes a light emitting unit that emits a 
light in a light emitting direction which is the direction to an object 

20 seated in a seat of a vehicle, the light having a plurality of pattern lights 
that are parallel to each other; a photographing device that obtains an 
image of the object along with a photographing direction; a memory that 
stores a computer program that makes it possible to execute a function 
of deriving a distance between the object and a predetermined position 

25 based on an interval between at least two of the pattern lights in the 



image obtained by the photographing device, and a function of 
controlling an operation of an air bag based on the distance derived; 
and a processor that can access the memory unit and execute the 
computer program. 
5 A method of detecting a distance according to still another 

aspect of the present invention includes emitting light in a light emitting 
direction to thereby irradiate an object, the light being having a 
distributed pattern in a predetermined direction; obtaining an image of 
the object along with a photographing direction, in such a manner that 

10 (a) the photographing direction is not in a plane that includes both the 
light emitting direction and the predetermined direction of the 
distributed pattern and (b) the photographing direction is not parallel to 
the light emitting direction; and deriving a distance between the object 
and a predetermined position based on a position of the pattern light in 

15 the image. 

A method of detecting a distance according to still another 
aspect of the present invention includes emitting light in a light emitting 
direction to thereby irradiate an object, the light having a plurality of 
pattern lights that are parallel to each other; obtaining an image of the 

20 object along with a photographing direction; and deriving a distance 
between the object and a predetermined position based on an interval 
between the pattern lights in the image. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 illustrates a structure of an air bag system controlling 
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apparatus according to a first embodiment of the present invention; 

Fig. 2 illustrates positions of a light emitting unit and a 
photographing apparatus; 

Fig. 3 illustrates a relation between a position of an object and a 
5 position of a line pattern in an image; 

Fig. 4 illustrates positions of the line pattern in the image; 

Fig. 5 illustrates a principle for deriving a distance between the 
object and a predetermined position; 

Fig. 6 illustrates another principle for deriving a distance 
10 between the object and the predetermined position; 

Fig. 7 is a block diagram of a distance deriving unit; 

Fig. 8 illustrates a position of reflected light in the image; 

Fig. 9 illustrates a table that stores a distance and a position of 
the reflected light, in a correlated form; 
15 Fig. 10 is a flowchart of a process executed by an air bag 

system controlling unit; 

Fig. 11 illustrates a structure of the air bag system controlling 
apparatus according to a second embodiment; 

Fig. 12 illustrates an image when the object is irradiated by light 
20 that includes a plurality of straight lines; 

Fig. 13 illustrates a principle for deriving a distance between the 
object and the predetermined position; 

Fig. 14 illustrates a structure of the air bag system controlling 
apparatus according to a third embodiment; 
25 Fig. 15 illustrates an image when the object is irradiated by light 



that includes cross marks; 

Fig. 16 illustrates distribution of a high-luminance part in the 
image when the object is irradiated by light in the form of a straight line; 

Fig. 17 illustrates a structure of the air bag system controlling 
5 apparatus according to a fourth embodiment; 

Fig. 18 illustrates a relation between a position of an object and 
positions of irradiating lights; 

Fig. 19 illustrates an example of an image of the object 
irradiated with three parallel lights; 
10 Fig. 20 illustrates an example of a vehicle that is equipped with 

the light emitting unit according to a first modification of the 
embodiments; 

Fig. 21 illustrates a principle for deriving a distance between the 
object and the predetermined position when the light emitting unit emits 
15 light from a front side; 

Fig. 22 is an illustration explaining a process, according to an 
example of a second modification, for determining a high-luminance 
part; 

Fig. 23 is an illustration explaining a process for determining a 
20 high-luminance part in a small block; 

Fig. 24 is another illustration explaining a process for 
determining a high-luminance part in a small block; 

Fig. 25 is an illustration explaining a process for determining a 
high-luminance part by eliminating non-continuous data; 
25 Fig. 26 illustrates a relation between a position of an object and 



positions of irradiating lights, according to a third modification ; 

Fig. 27 illustrates an example of how reflected light is extracted 
from two images according to a fourth modification; 

Fig. 28 illustrates another example of how reflected light is 
5 extracted from two images; and 

Fig. 29 is an illustration of a structure of the air bag system 
controlling apparatus according to a sixth modification. 

DETAILED DESCRIPTION 

10 Exemplary embodiments of a distance detecting apparatus, an 

air bag system controlling apparatus, and a method of detecting a 
distance according to the present invention are described in detail 
below with reference to the accompanying drawings. 

Fig. 1 illustrates a structure of an air bag system controlling 

15 apparatus according to a first embodiment of the present invention. 

The air bag system controlling apparatus 100 has a distance detecting 
function for detecting a distance. The air bag system controlling 
apparatus 100 includes a photographing apparatus 110, a light emitting 
unit 120, a holding mechanism 130, a distance deriving unit 140, and, an 

20 air bag system controlling unit 150. 

The photographing apparatus 110, such as a video camera, 
photographs; in a region of infrared radiation. The photographing 
apparatus 110 is fixed and is held in a predetermined position by the 
holding mechanism 130 so that the photographing apparatus 110 

25 photographs an upper body of an occupant (hereinafter, "object") 102 

9 



seated in a seat, in a predetermined direction (hereinafter, 
"photographing direction"), to obtain an image. The photographing 
direction is adjusted so that the object 102 is in a photographing region 
SA, which is inside of a frame illustrated in the figure with a two-dashed 
5 line. 

The light emitting unit 120 emits light and irradiates the object 
102. The light emitting unit 120 emits the light over an area from a 
diagonal forward position of the object 102 (front side in Fig. 1 ) to a 
center of the seat 101 (horizontal direction in Fig. 1 ). In other words, 

10 the light is emitted to a center of the object 102 (hereinafter, "light 
emitting direction"). 

The light emitting unit 120 emits infrared radiation so that the 
object 102 does not feel dazzled. The light emitting unit 120 includes 
an infrared emission diode as an emitting means in a steel frame having 

15 a slit. 

The light emitting unit 120 emits a pattern light that distributes in 
a predetermined direction. A direction of the pattern light is different 
from the light emitting direction. The pattern light extends in the form 
of straight line and is perpendicular to the light emitting direction. 

20 Fig. 2 illustrates positions of a light emitting unit and a 

photographing apparatus. The holding mechanism 130 holds and fixes 
the photographing apparatus 110 and the light emitting unit 120 so that 
the object is within the photographing region SA. 

Such positions can be achieved if the following two conditions 

25 are fulfilled. 



The first condition is that the photographing direction of the 
photographing apparatus 110 is not be parallel to the light emitting 
direction of the light emitting unit 120. 

The second condition is that the photographing direction of the 
5 photographing apparatus 110 is not in a plane H that includes the light 
emitting direction and the pattern light. 

As illustrated in Fig. 1, the holding mechanism 130 may include 
a frame that has two ends and that has a shape of a horseshoe, so that 
the ends of the frame may support the photographing apparatus 110 
10 and the light emitting unit 120. Other structures may be used as the 
holding mechanism 130 as long as both the photographing apparatus 
110 and the light emitting unit 120 are held at positions those fulfills the 
above-mentioned two conditions. For example, the photographing 
apparatus 110 and the light emitting unit 120 may be held respectively 
15 by different frames that are fixed to a material in a vehicle, such as a 
dashboard. 

The distance deriving unit 140 derives a distance between the 
object 102 and a predetermined position (for example, a front part of 
the dashboard) based on the image obtained by the photographing 

20 apparatus 110. More precisely, the light reflected from the object 102 
extends vertically in the form of a straight line in the image (hereinafter, 
"line pattern in the image"). A position of the line pattern is identified 
from the image, and then the distance between the predetermined 
position and the object 102 is derived using the position of the line 

25 pattern in the image. 



A principle for deriving the distance between a position of the 
object 102 that is identified based the position of the line pattern in the 
image, and the predetermined position, will be explained next with 
reference to Fig. 3, Fig. 4, and Fig. 5. For the sake of convenience, it 
5 is assumed that the object 102 is in a plane. 

Fig. 3 illustrates a relation between a position of the object and 
a position of the line pattern in the image. When the object is in a 
nearest position (1), a line pattern in the image (a) is located in the left 
side as viewed from the photographing apparatus 110 (front side in Fig. 

10 3). When the object is in the farthest position (3), a line pattern in the 
image (c) is located in the right side as viewed from the photographing 
apparatus 110. When the object is in a position (2) that is between the 
position (1) and the position (3), a line pattern in the image (b) is 
located in between the position (a) and the position (c) as viewed from 

15 the photographing apparatus 110. 

Fig. 4 illustrates positions of the line pattern in the image. As 
illustrated in Fig. 3 and Fig. 4, the greater the distance between the 
object and the predetermined position is, the more the line pattern in 
the image is located to right side in the image. 

20 Fig. 5 illustrates a principle for deriving a distance between the 

object and a predetermined position. If a line that connects the light 
emitting unit 120 and the photographing apparatus 110 is perpendicular 
to a distance detecting direction, a distance Z can be represented by an 
equation (1): 
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_ dtana*tan8 

Z ... (1) 

tana + tan9 

where d is a distance between the photographing apparatus 110 and 
the light emitting unit 120, and the value of d is known because the 
photographing apparatus 110 and the light emitting unit 120 are fixed. 
5 An angle a is known from a position of the light emitting unit 1 20 and 
the light emitting direction. An angle 9 has a mutual relationship with 
the position of the line pattern in the image so that the angle 9 can be 
derived from the line pattern in the image in Fig. 4. Thus, the distance 
Z can be represented by the equation (1). 

10 The distance Z may be derived from a distance between the 

object 102 and a line connecting the light emitting unit 120 and the 
photographing apparatus 110. However, any other approach that uses 
a distance between the object 102 and a different line may be used. In 
such a case, a position of the line is known from the positions of the 

15 photographing apparatus 110 and the light emitting unit 120, and also a 
distance between another line and the predetermined position, such as 
a front part of the dashboard, is known. Therefore, a distance between 
the object 102 and the predetermined position may be derived from the 
distance Z and the other known distances. 

20 Fig. 6 illustrates another principle for deriving a distance 

between the object and the predetermined position. When the line 
connecting the photographing apparatus 110 and the light emitting unit 
120 is not perpendicular to the distance detecting direction, a distance 
between a virtual line and the object can be derived, where the virtual 



line may be perpendicular to the distance detecting direction. 

Thus, based on the position of the line pattern in the image, the 
distance deriving unit 140 can derive a distance between the object 102 
and the predetermined position, such as a front of the dashboard. 
5 Fig. 7 is a block diagram of the distance deriving unit. The 

distance deriving unit includes a reflected light position determining unit 
142, a distance measuring unit 143, and a table for deriving distance 
144. The reflected light position determining unit 142 identifies the 
position of the line pattern in the image, which is in the form of straight 

10 line. If the object 102 is in a plane that is perpendicular to the distance 
detecting direction, the line pattern in the image is in the form of 
straight line and is brighter (hereinafter, "high-luminance part") as 
compared to other parts in the image. 

However, the object 102 may not always be in a plane and may 

15 have various postures. Consequently, the line pattern in the image is 
not always in the form of a straight line. Moreover, when a vehicle 
collides, the object 102, who is a person of average build, rarely 
inclines greatly due to vibrations of the collision. Therefore, the line 
pattern in the image may be nearly in the form of straight line although 

20 there may be minor curves. Such a form having curves may be 
assumed to be a straight line. 

It is possible to identify the high-luminance part by dividing the 
image horizontally into numerous lines and extracting coordinates of an 
image element having the highest high-luminance. For the purpose of 

25 identifying the high-luminance part with more accuracy, an application 



such as a primary differential filter of horizontal direction may be 
applied to the image so as to calculate a spatial change of the 
luminance and an absolute value. A digital filter such as a Sobel 3x3 
filter 
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may also be used. 

Any other filtering method that relatively enhances the 
high-luminance part in the form of straight line may be used. After the 
filtering, the high-luminance part is identified by extracting an image 
element of the high-luminance part from the image. For example, a 
3x3 secondary differential filter such as a laplacian filter 
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may be used. 

When the laplacian filter is applied to enhance the 
high-luminance part, an image l(x, y) is generated. The reflected light 
position determining unit 142 identifies the position of the line pattern in 
the image from the image l(x, y) using an equation (2) given below. 
That is, as illustrated in Fig. 8, distribution of the luminance part in each 
horizontal line is detected, a horizontal coordinate of the highest 
luminance part (illustrated as black circle in Fig. 8) is selected, and then 
a function P(y), which represents the position of the line pattern in the 

15 



image as a parameter of vertical coordinate, is generated. When a 
luminance value is l(x, y), then P(y) is represented by the equation (2): 

P(y) = |x|max = l(x,y)} ... (2) 

If the object 1 02 is in a plane, and if a normal vector of the plane 
5 containing the object 102 and a normal vector of the plane H containing 
the light emitting direction and the light distributing direction are 
coplanar, then the high-luminance pattern in the image l(x, y) is a 
straight line perpendicular to the object 102. However, in practice, the 
high-luminance pattern does not exactly form a straight line because 

10 the object 102 is not in a plane and also the object 102 may have 

various postures. Thus, the line pattern in the image is not in the form 
of straight line, and therefore, P(y) may have various values 
corresponding to a vertical coordinate. 

The reflected light position determining unit 142 identifies from 

15 the high-luminance part, one of the positions of the line pattern in the 
image as Ph (hereinafter, "position Ph"). The reflected light 
determining unit 142 identifies the shortest distance as the position of 
the line pattern in the image in P(y). In other words, as described with 
reference to Fig. 2, Fig. 3, and Fig. 4, the more the line pattern in the 

20 image is located in the left side, the shorter a distance between the 
object 102 and the predetermined position is. Therefore, a left-most 
position of the line pattern in the image is chosen from P(y) as Ph. 
That is, the position Ph is derived using an equation (3): 

Ph=minP(y) ... (3) 



Thus, it is possible to detect an appropriate distance between 
the object 102 and the predetermined position, such as a front part of a 
dashboard, even if the object 102 leans, or a face or arms of the object 
102 are closer to the dashboard. In other words, the nearest part of 
5 the body of the object 102 can be detected. Therefore, the air bag 
system controlling unit 150 can be controlled appropriately. 

The distance measuring unit 143 derives a distance between the 
object 102 and the predetermined position based on the position Ph. A 
principle for deriving the distance based on the position Ph is described 

10 above with reference to Fig. 3, Fig. 4, and Fig. 5. It may be possible to 
derive the distance using the formula (1). In this embodiment, use of a 
table for deriving a distance 144 reduces the calculation load of the 
distance measuring unit 143. 

As illustrated in Fig. 9, the table for deriving a distance 144 

15 stores, in correlated form, the position Ph that is pre-calculated and a 
distance corresponding to the value of the position Ph. The distance 
measuring unit 143 acquires the distance corresponding to the position 
Ph from the table for deriving a distance 144. Then, the distance 
measuring unit 143 outputs the distance to the air bag system 

20 controlling unit 150 illustrated in Fig. 1. 

The air bag system controlling unit 150 controls an operation of 
the air bag system based on the distance supplied by the distance 
deriving unit 140 when the operation is required. For example, when a 
vehicle equipped with the air bag system controlling apparatus 100 

25 collides and a sensor (not shown) detects the collision, the air bag 



system controlling unit 150 controls the operation of an air bag system. 

More precisely, the air bag system controlling unit 150 controls 
an explosive power of the air bag system based on the distance. A 
plurality of packets that include appropriate amount of explosive 
5 material are equipped, and then the number of packets to be exploded 
is specified based on the distance. For example, when the distance is 
longer, the air bag system controlling unit 150 controls the explosive 
power in such a way that the air bag expands more. For example, 
when the distance is between 0 cm to 30 cm, the explosive power is 

10 small, and only one packet is exploded. When the distance is between 
30 cm to 40 cm, the explosive power is moderate, and two packets are 
exploded. When the distance is more than 40 cm, the explosive power 
is large, and three packets are exploded. 

An operation of the air bag system controlling unit 150 is 

15 explained below with reference to the flowchart in Fig. 10. The air bag 
system controlling unit 150 decides whether it is time to operate the air 
bag system (step Sa1). 

If the operation of the air bag system is required, the air bag 
system controlling unit 150 provides a control so that the light emitting 

20 unit 120 and the photographing apparatus 110 operate (step Sa2). 
While the light emitting unit 120 is emitting light, the 
photographing apparatus 110 photographs the object 102, and the 
distance deriving unit 140 acquires the image of the object 102 (step 
Sa3). Based on the image, the distance deriving unit 140 derives a 

25 distance between the object 102 and the predetermined position (step 



Sa4). 

The distance derived by the distance deriving unit 140 is 
supplied to the air bag system controlling unit 150 that controls the air 
bag system based on the distance (step Sa5). 
5 Thus, the air bag system controlling apparatus 100 can control 

an explosive power of the air bag system based on the distance 
between the predetermined position (a front part of the dashboard) and 
the object so as to provide an appropriate operation of the air bag 
corresponding to a posture of the object on the seat 101. Therefore, it 

10 is possible to reduce inappropriate operation of the air bag, such as 
exploding with a big power when the object is near the dashboard. 

Thus, in the first embodiment, for controlling the air bag, the 
light emitting unit 120 emits light and irradiates the object 102, the 
distance deriving unit 140 identifies the position of the line pattern in 

15 the image, which includes an image of an upper body of the object 1 02 
and derives the distance. 

Further, because the light distributing direction is a straight 
vertical direction, the whole of the upper body of the object 102 can be 
irradiated. Thus, a distance is derived by identifying the position of the 

20 line pattern in the image. Even if the object has various postures, a 
distance between each part of the upper body of the object and the 
predetermined position is derived. An appropriate operation of the air 
bag is possible, because the shortest distance between the object and 
the predetermined position is considered. 

25 Moreover, the air bag system controlling unit 150 controls the 



light emitting unit 120 and the photographing apparatus 110 if an 
operation of the air bag is necessary. As the light emitting unit 120 
does not emit light to irradiate the object 102 except when the operation 
of the air bag required, the object does not feel uncomfortable, or feel 
5 dazzled. 

When the light emitting unit 120 and the photographing 
apparatus 110 operate, the distance must be derived quickly, because 
the air bag must be operated immediately. This can be achieved, 
because the distance measuring unit 143 derives a distance by 

10 referring to the table for deriving a distance 144, which saves time. 

Fig. 11 illustrates a structure of an air bag system controlling 
apparatus according to a second embodiment. The air bag system 
controlling apparatus 200 according to the second embodiment is 
different from that of the first embodiment in the following two ways. 

15 First, in the air bag system controlling apparatus 200, a light emitting 
unit 220 emits a plurality of lights toward the object 102 (2 lights are 
shown in the figure). Second, the distance deriving unit 240 derives 
the distance based on positions of plurality of reflected lights in an 
image photographed by the photographing apparatus 110. In the 

20 second embodiment, the structural elements that have the same or 
similar structures or the same or similar functions have been provided 
with the same reference numerals as those in the first embodiment. 

The light emitting unit 220 emits two lights in a direction 
identical to the light emitting direction in the first embodiment. These 

25 lights are in the form of straight lines and are positioned in the same 



distributing direction as in the first embodiment. The light emitting unit 
220 may be a steel case that includes an infrared lamp, such as an 
infrared emitting diode, as an emitting means, and that has a plurality of 
vertical slits. However, a plurality of steel cases that irradiate one light 
5 each may be provided. 

Fig. 12 illustrates an example of an image obtained by the 
photographing apparatus 110. The image contains the object 102 
irradiated by the light emitting unit 220. The image includes two 
reflected lights HK in the form of straight lines that extend in a vertical 

10 direction. The positions of the reflected lights change as a position of 
the object 102 changes. 

Fig. 13 illustrates a principle for deriving a distance between the 
object and the predetermined position. If a line connecting the light 
emitting unit 220 and the photographing apparatus 110 is perpendicular 

15 to a distance detecting direction, a distance Z1 and a distance Z2 can 
be represented by equations (4) and (5), based on the same distance 
detecting principle as in the first embodiment. The distance Z1 and 
the distance Z2 are a distance between the line connecting the light 
emitting unit 220 and the photographing apparatus 110, and the object 

20 102. 

d-tancL •tan0 1 

Z 1 = ... (4) 

tanc^ + tanG., 

_ d • tana 2 • tan9 2 
tana 2 +tan6 2 

An angle a1 and an angle a2 are known from a position of the 

21 • 



light emitting unit 220 and the light emitting direction. An angle 81 and 
an angle 02 have a mutual relationship with a position of the reflected 
light in the image. Therefore, the angle 01 and the angle 02 can be 
respectively derived from the position of the reflected light. In other 
5 words, the distance Z1 and the distance Z2 can be represented by the 
equations (4) and (5). 

If the line between the light emitting unit 220 and the 
photographing apparatus 110 is not perpendicular to the distance 
detecting direction, a distance between a virtual line and the object 102 

10 can be derived, as illustrated in Fig. 6. Accordingly, the virtual line is 
defined to be perpendicular to the distance detecting direction. 

The distance deriving unit 240 specifies positions of the 
reflected light Ph1 and Ph2 by the same procedure used by the 
distance deriving unit 140 in the first embodiment. As a result, the 

15 distance Z1 and the distance Z2 can be represented by the equations 
(4) and (5), respectively, based on the positions of the reflected light 
Ph1 and Ph2. 

If the object 1 02 is in a plane that is perpendicular to the 
distance deriving direction, the distance Z1 is equal to the distance Z2 
20 in theory. However, the object 102 may not be in a plane and is likely 
to be slanted depending on posture, and hence, the distance Z1 is not 
equal to the distance Z2. Therefore, the smaller value of the two is 
chosen as the distance and is output to the air bag system controlling 
unit 150. 

25 The air bag system controlling unit 150 provides control to 



expand an air bag by an explosive power that depends on the distance 
obtained from the distance deriving unit 240. 

In the air bag system controlling apparatus 200 according to the 
second embodiment, two lights are irradiated towards an upper body of 
5 the object 102 and the distance is derived based on positions of the 
light reflected from two lights, thereby enabling detection of the 
distance of different parts of the object, even if the object 102 has 
various postures. 

By detecting the shortest distance from the part of the body, it is 
10 possible to control the explosive power of the air bag. 

Thus, expanding the air bag by an excessive explosive power 
can be avoided. In such a manner, it is possible to control the air bag 
appropriately according to the posture of the object when a collision 
occurs. 

15 In the second embodiment, although the smaller value from the 

distance Z1 or the distance Z2 is chosen, an average of the distance Z1 
and Z2, or one of the distances Z1 and Z2 may be used. 

Fig.. 14 illustrates a structure of an bag system controlling 
apparatus according to a third embodiment. In an air bag system 

20 controlling apparatus 300, a light emitting unit 320 emits light, which 
has different form from that of the light emitting unit 120 of the first 
embodiment. In the third embodiment, the structural elements that 
have the same or similar structures, or the same or similar functions 
have been provided with the same reference numerals as those in the 

25 first embodiment. 



The light emitting unit 320 emits light in the same direction as 
that of the light emitting unit 120. However, the light distributes in a 
dispersed manner, not in the form of a straight line. In other words, 
many predetermined pattern lights are emitted so as to be disposed in a 
5 vertical direction. 

The pattern lights may have any pattern. However, it is 
preferable to emit pattern lights that can be easily distinguished from 
natural light. For example, as illustrated in Fig. 15, a pattern light that 
includes a plurality of cross marks JR is emitted for irradiating the 
10 object 102. 

The light emitting unit 320 may be a steel case, which includes 
as an emitting means an infrared lamp, such as an infrared emitting 
diode, and has plurality of slits arranged vertically, each forming a cross 
mark. 

15 The image includes many cross marks because the light is 

emitted in the form of cross marks. The position of these cross marks 

varies as a position of the object 102 changes. 

A distance deriving unit 340 derives a distance between a 

predetermined position and the object 102 based on positions of the 
20 cross marks. The procedure for deriving the distance from the position 

of the cross mark Ph is the same as that in the first embodiment. 

However, a procedure to identify the position of the cross marks is 

different. 

The distance deriving unit 340 recognizes and processes image 
25 data supplied by the photographing apparatus 110, and then recognizes 



and identifies a high-luminance part from the cross marks in the image. 

As the light includes cross marks, which are almost non-existent in 

nature, it is possible to reduce a false detection. 

More precisely, in a case when the object is irradiated with light 
5 in the form of straight lines, high-luminance parts are distributed in the 

image as illustrated in Fig. 16. If the object is in a plane, these black 

circles should be distributed in the vertical direction as a straight line. 

However, this image may include other lights. For example, if the 

object 102 wears glasses, some other lights are reflected on the 
10 glasses. Also, in some cases, these high-luminance parts may be 

dispersed widely noise. 

As described above, when the object is irradiated by light in the 

form of a straight line, the high-luminous parts do not always represent 

an accurate position of the cross mark because of the other lights or 
15 noise. In such a case, the accuracy of the distance reduces. 

On the other hand, when the object is irradiated by light that 

includes cross marks, and the high-luminance parts in the image are 

identified, the false detection of the other lights can be reduced. 

Furthermore, detection of the identified position is unlikely to be 
20 affected by noise. Consequently, the position of the reflected light can 

be derived accurately. 

The distance deriving unit 340 identifies the positions Ph of the 

cross marks from these positions Ph, for example, a center of the cross 

marks, and derives a distance between the object 102 and the 
25 predetermined position such as a front part of a dashboard, based on 



the positions Ph. 

The air bag system controlling unit 150 controls an operation of 
the air bag based on the distance derived by the distance deriving unit 
340. 

5 In the air bag system controlling apparatus 300, the position of 

the reflected light from the object 102 is identified using the pattern light 
that includes cross marks. Because such light does not exist in nature, 
the distance is derived more accurately.. 

These pattern lights are irradiated in the vertical direction . on the 

10 whole of the upper body of the object 1 02 and the distance is derived 
based on the position of the cross marks. Therefore, it is possible to 
detect the distance up to different parts of the object, even if the object 
102 has various postures. 

In the air bag system controlling apparatus 300, the distances 

15 up to different parts of the object 102 are detected, and then the 
smallest value among these distances is chosen. As a result, it is 
possible to control the explosive power of the air bag appropriately. 

An air bag system controlling apparatus according to a fourth 
embodiment is explained below with reference to Fig. 17. An air bag 

20 system controlling apparatus 400 in the fourth embodiment is different 
from that in the first embodiment in the following two ways. First, in 
the air bag system controlling apparatus 400, a light emitting unit 420 
emits a plurality of lights towards the object 102. Second, the distance 
deriving unit 440 derives the distance based on the positions of two 

25 lights reflected from the object. In the fourth embodiment, the 



structural elements that have the same or similar structures, or the 
same or similar functions have been provided with the same reference 
numerals as those in the first embodiment. 

The light emitting unit 420 shown in Fig. 18 emits two lights in 
5 the same light emitting direction as that in the first embodiment. 

These lights are in the form of straight lines that are positioned in the 
same distributing direction as in the first embodiment. Moreover, the 
lines are parallel to each other. 

The light emitting unit 420 may be a steel case that includes an 
10 infrared lamp, such as an infrared emitting diode, as an emitting means. 
A plurality of units that emit one light each may be provided instead of 
one unit that emits a plurality of lights. 

The photographing apparatus 110 photographs the upper body 
of the object 1 02, irradiated by the light emitting unit 420. The 
15 distance deriving unit 440 derives the distance between the object 102 
and the predetermined position based on the position of two reflected 
lights in the image. 

Fig. 18 illustrates a relation between a position of an object and 
irradiating positions of irradiating lights (one-dot-dashed lines in the 
20 figure), when the light emitting unit 420 emits a plurality of lights and 
irradiates the object. The object is in a plane and may move nearer or 
farther in a distance detecting direction. Whether the object is in a 
. position A, B, or C, a distance dl between the two irradiating positions 
is constant. And, when the distance dl is constant, the farther the 
25 object is from the photographing apparatus 110, the lesser is the 



distance between the irradiating positions in the image. 

The distance deriving unit 440 derives the distance based on the 
above relationship. In other words, the distance from the object 102 is 
derived based on the distance between positions of the reflected lights. 
5 A function, which determines the distance from the object using the 
distance between positions of the reflected lights, may be used. 
Alternatively, a look-up table that stores the distance between positions 
of the reflected lights and the distance from the object may be also 
used. 

10 The air bag system controlling unit 150 controls an operation of 

the air bag based on the distance derived by the distance deriving unit 
440. 

As described above, in the air bag controlling unit 400, the 
object 102 is irradiated by light in the form of two parallel lines and the 
15 distance from the object 102 is derived based on the distance between 
positions of the reflected light in the image. The distance derived 
controls the operation of the air bag. Further, the operation of the air 
bag is appropriately controlled depending on the postures of the object. 
Also, in the air bag controlling unit 400, the distance of the 
20 object 102 is identified by the distance between the irradiating lights. 
As a result, it is possible to detect the distance up to different parts of 
the object, even if the object 102 has various postures. 

By detecting the shortest distance between the object and the 
predetermined position, an explosive power that depends on the 
25 distance can be controlled. 
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In the fourth embodiment, lights in the form of two parallel lines 
are irradiated to the object 102 and the distance between positions of 
the reflected lights is used to control the operation of the air bag. 
However, lights in the form of more than three parallel lines may be 
5 used to irradiate the object 102 and the distance between positions of 
the reflected lights may be derived using two of these lines. 

For example, as illustrated in Fig. 19, three lights are used, and 
hence three positions S1 1 , SI2, and SI3 are photographed in the image. 
The distance from the object 102 may be derived from a distance D12, 
10 which is a distance between the position SI1 and the position SI2, and 
the distance D23, which is a distance between the position SI2 and the 
position SI3. 

The distance deriving unit 440 may derive the distance from the 
object 1 02 using a mean value of the distance D1 2 and the distance 
15 D23, and then output the distance derived to the air bag system 
controlling unit 150. Alternatively, the smallest distance from the 
distances derived using the distance D12 or the distance D23, may be 
output to the air bag system controlling unit 150. 

The present invention is not limited to the above embodiments, 
20 but can be modified in the ways explained below. 

Although the light emitting unit 120 (220, 320, 420) emits light 
and irradiates the object 1 02 from an oblique front side, the light may 
be emitted from other sides as long as the positional relation with the 
photographing direction of the photographing apparatus 110 fulfills the 
25 . necessary conditions. 



Fig. 20 illustrates an example of a vehicle that is equipped with 
the light emitting unit of the air bag system controlling apparatus 
according to a first modification. The light emitting unit 120 is attached 
to a front roof above the seat 1 01 , and the light may be emitted from a 
5 front side or an upper side of the object 1 02. 

In a case that the light emitting unit 120 emits light and 
irradiates the object 102 from the front side, that is, in a distance 
detecting direction, the distance from the object 102 is derived using 
the same principle as that in the first embodiment. As illustrated in Fig. 

10 21, when a line connecting the light emitting unit 120 and the 

photographing apparatus 110 is perpendicular to the distance detecting 
direction, the distance Z between the line and the object 102 can be 
represented by the equation (1). An angle a is equal to 90°. 

In the first embodiment, the distance detecting unit 140 chooses 

15 a horizontal coordinate value that has a maximum luminance, and 

generates the function P(y) that represents the position of the reflected 
light. This function P(y) uses a vertical coordinate as a parameter and 
the high-luminance part is identified in each horizontal line. On the 
other hand, as one example of a second modification, the position of 

20 the reflected light Ph may be identified in each small block SB (see Fig. 
22). 

As illustrated in Fig. 23, a line is derived using least square 
approximation, based on positions of high-luminance pixels (shown as 
black circles) identified in a small block SB. The line derived 
25 represents the position of the reflected light in each small block SB, and 
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then a position of the reflected light Ph is derived from the positions of 

the reflected lights in the image. Therefore, the position of the 

reflected light Ph, which represents the smallest distance from the 

object 102, is identified. 
5 Accordingly, even if the high-luminance part varies widely 

because of noise, an average position of the reflected lights can 

eliminate an influence of noise. As a result, the distance can be 

detected more accurately. 

Similarly, in the third embodiment, a line may be derived using 
10 least square approximation based on the positions of the cross marks, 

and then a position of the reflected light Ph may be derived from the 

line, as illustrated in Fig. 24. 

The line in each small block SB must be continuous so that the 

entire line is continuous to a certain extent. The reflected light does 
15 not always form a straight line because the object 102 is not in a plane 

and is likely to be slanted. 

If there is a non-continuous part in the image, the 

non-continuous part is excluded from the image, and the position of the 

reflected light is identified. In Fig. 25, a high-luminance part, which is 
20 circled, is detected as noise and excluded from the image. In other 

words, the high-luminance part that is continuous is detected as the 

reflected light. 

The non-continuous part is detected as follows. The horizontal 
coordinate value of a line in a small block SB is compared with 
25 coordinate values of other lines in other small blocks. The horizontal 



coordinate value that is far from other values, is considered as the 
non-continuous part. 

As described above, a non-continuous part in the image is 
considered as noise. However, the distance may be derived by 
5 identifying the position of the reflected light by other predetermined 
rules. 

In the second embodiment, the light emitting unit 220 emits two 
lights, which have a relation as follows. As illustrated in Fig. 26, the. 
two lights are emitted at an angle (3, and are not parallel to each other. 

10 In such a state, the farther an object is from the light emitting unit 220, 
the greater is the distance between irradiating positions. 

More precisely, when the object is in a position A near the light 
emitting unit 220, a distance 'da' represents a distance between the two 
irradiating positions. When the object is in a position B distant from 

15 the light emitting unit 220, a distance *db' represents a distance 

between the two irradiating positions. Comparing the distance 'da' 
with the distance db, the distance 'db 1 is greater than the distance 'da'. 

In the fourth embodiment, when the distance between the 
irradiating positions is constant, the farther the object is from the 

20 photographing apparatus 110, the distance between the irradiating 
positions becomes shorter in the image. As a third modification, the 
two lights may be emitted at an angle (3 and the distance between the 
irradiating positions is constant in the image. This angle p is derived 
under a condition that the object is in a plane, which is perpendicular to 

25 a distance detecting direction. 



In the second embodiment, the distance deriving unit 240 
derives the distance from the object 102 based on the identified 
positions of the two lights in the form of a straight line. If the object is 
in a plane that is perpendicular to the distance detecting direction, the 
5 distance between the two lights is constant. 

However, in the third modification, the distance deriving unit 240 
identifies high-luminance parts from the two lights in the form of straight 
lines, and compares a distance between the high-luminance parts with 
the constant distance between the two lights as explained above. If 

10 the distance between the high-luminance parts corresponds with the 
constant distance, the two high-luminance parts are detected as 
positions of the reflected lights. However, if the distance between the 
high-luminance parts does not correspond with the constant distance, 
the two high-luminance parts are detected as positions of the reflected 

15 lights provided that a difference between these distances is within a 
margin of an error. 

Thus, other unrelated lights in the form of straight lines present 
in the image are not detected. Consequently, the position of the 
reflected light is identified accurately and the distance is derived. 

20 In each embodiment, the distance is derived using the image 

photographed by the photographing apparatus 110 when the light 
emitting unit 120 (220, 320, 420) emits light and irradiates the object 
102. However, as a fourth modification, the distance may be also 
derived based on both, an image when light is emitted, and an image 

25 when light is not emitted. 



More precisely, the air bag system controlling unit 150 controls 
the light emitting unit 120 (220, 320, 420) and the photographing 
apparatus 110 at the time of the operation of the air bag. After 
photographing a first image when light is emitted, the air bag system 
5 controlling unit 150 controls the light emitting unit 120 (220, 320, 420) 
so as not to emit light, and then a second image is photographed. 

Accordingly, as illustrated in Figs. 27 and 28, the first image 
includes a line of the reflected light on the upper body of the object 1 02. 
On the other hand, the second image, when light is not emitted, 
10 includes the object 102, but does not include the reflected light. 

Thus, in the fourth modification, the distance deriving unit 140 
(240, 340, 440) extracts the reflected light based on a difference 
between the two images and identifies a position of the reflected light. 
In other words, an image that includes only the reflected light 
15 (hereinafter, "difference image") is obtained by deducting the second 
image from the first image. Therefore, a high-luminance part k, which 
is caused by other lights, is excluded from the difference image. 

Thus, the position of the reflected light identified in the 
difference image is used to derive the distance of the object 102 from 
20 the predetermined position. 

As described above, the distance detecting unit derives the 
distance from the object 102 based on the image when light is emitted 
by the light emitting unit. In each embodiment, the distance detecting 
unit and the distance deriving method are applied to the air bag 
25 controlling apparatus. 



The distance detecting unit and the distance deriving method 
are also used for other purposes. For example, the distance detecting 
unit and the distance deriving method may be used as an interface in 
game machines. More precisely, this invention may be applied in 
5 game machines in order to detect a distance between a player and a 
predetermined position, and the distance may be reflected as an 
indicating signal from the player in a game process. 

When the distance detecting unit and the distance deriving 
method are applied to other purposes, any object can be detected. As 

10 a fifth modification, if the position of the object fulfils conditions given 
below, the high, luminance pattern forms a straight vertical line in the 
image. A first condition is that the object must be in a plane that is 
perpendicular to the distance detecting direction. A second condition 
is that a normal vector on the plane shares a plane with another normal 

15 vector, which is in a plane that includes the light emitting direction and 
the light distributing direction. The position of the reflected light may 
be identified using a known method of detecting a straight line, such as 
Hough Transform. 

If the object is in the plane as described above, the 

20 high-luminance pattern is supposed to form a straight line. However, 
in fact, the function P(y) does not generate constant values if noise is 
present. Therefore, the position of the reflected light can be identified 
using an averaged value or a median by the function P(y), thereby 
eliminating noise. 

25 As described above, the distance deriving unit 140 (240, 340, 



440) and the air bag system controlling unit 150 are composed of 
hardware circuits. However, as a sixth modification, a computer unit 
500, which includes a central processing unit (CPU) 510 and a memory 
520, may be used instead of the distance deriving unit and the air bag 
5 system controlling unit (see Fig. 29). The computer unit 500 may 
include programs that realize a distance detecting process and an air 
bag controlling process. 

In other words, an air bag system controlling apparatus 501 may 
be composed of the computer unit 500, which executes the same 

10 processes as those in each of the above embodiments. At the time of 
the operation of the air bag, the computer unit 500 runs programs such 
as the distance detecting process and the air bag controlling process 
stored in the memory 520. 

The present invention has been described for detecting a 

15 distance of a part of an object from a predetermined position. 

However the present invention is not limited thereto, and can be applied 
to detecting a distance of the entire object. 

Additional advantages and modifications will readily occur to 
those skilled in the art. Therefore, the invention in its broader aspects 

20 is not limited to the specific details and representative embodiments 
shown and described herein. Accordingly, various modifications may 
be made without departing from the spirit or scope of the general 
inventive concept as defined by the appended claims and their 
equivalents. 

25 
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